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Introduction 

This  Project  started  on  August  1,  1999,  with  the  goal  to  find  out,  via  a  feasibility  study, 
whether  a  centric  minded  imaging  (CMI)  block,  the  Panoramic  Annular  Lens  (PAL)  -  similar 
to  that  which  was  used  in  the  PAL  Attitude  Determination  System  (PALADS)  of  the  micro- 
satellite  SEDSAT-1  launched  on  October  24,  1998,  -  could  be  adapted  to  military  video  sys¬ 
tems,  such  as 

1.  Azimuth  determination  system  (ADS) 

2.  Sniper  fire  location  display  (SFLD) 

3.  Helicopter  blade  tracking  system,  (HBTS), 

The  assumption  was  that  this  can  be  achieved  by  re-designing  the  PAL,  increasing  its  ver¬ 
tical  viewing  angle,  and  adding  to  the  PAL-based  vision  system  a  humanoid  “flair”. 


Theoretical  basis  of  PAL 

The  main  characteristics  of  any  centric 
minded  imaging  (CMI)  system  is  that  it  is 
in  the  center  of  the  coordinate  system  that 
describes  the  three-dimensional  scene,  and 
not  on  its  periphery,  as  in  the  case  of  con¬ 
ventional  see-through-window  (STW)  im¬ 
aging  strategy. 

In  STW  strategy,  one  “sees”  the  3D 
world  only  through  discrete  chunks  as  if 
looking  through  a  window  by  moving  the 
head  up  and  down  or  turning  around.  As  a 
result,  due  to  this  effect  of  frame  phe¬ 
nomenon,  one  cannot  get  full  3D  informa¬ 
tion  in  real  time.  CMI  based  systems,  how¬ 
ever,  because  of  their  being  in  the  center  of 
the  3D  space,  totally  eliminate  this  draw¬ 
back  of  STW  imaging.  The  most  up-to- 
date  CMI  block  is  the  Panoramic  annular 
Lens  (PAL)1 

PAL  considers  namely  the  visual  field 
to  be  cylindrical,  rather  than  spherical.  The 
image  of  object  points  will  then  be  pro¬ 
jected  first  onto  an  imaginary  cylinder  wall 
that  is  located  at  a  distance  equal  to  the 
prevailing  vision  distance,  and  then,  -  us¬ 
ing  some  mathematically  well  describable 
optical  stretching  maneuvers  -  this  pano¬ 
ramic  image  projection  will  be  transformed 
onto  a  plane  perpendicular  to  the  axis  of 
the  cylinder.  (Fig.  1) 
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Fig.l.  Principle  of  CMI 

As  a  result,  the  whole  360°  visual  field 
-  and  not  only  a  segment  or  a  frame  of  the 
selected  visual  angle  -  will  appear  on  the 
plane  surface  as  an  annular  image,  and  the 
image  points  retain  the  same  1:1  relation  of 
the  original  object  points.  The  width  of  the 
ring  will  correspond  to  the  vertical  viewing 
angle  of  the  PAL,  while  points  on  concen¬ 
tric  rings  will  represent  different  horizontal 
spatial  angles  within  a  given  vertical 
viewing  angle.  Thus,  the  two-dimensional 
skeleton  of  the  three-dimensional  world 
will  be  encoded  in  this  annular  image, 
which,  at  the  first  sight,  looks  like  a  cross 
section  image  as  we  are  accustomed  to,  but 
it  is  not. 

This  leads  also  to  the  coding  of  the  ap¬ 
pearance  of  depth  on  a  two-dimensional 
surface  as  a  convergence  into  one  point, 
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resulting  in  just  one  single  vanishing  point. 
For  this  3D  optical  coding  method,  the 
term  Flat  Cylinder  Perspective  (FCP)  im¬ 
aging  was  introduced.  Here  the  entire  360° 
panoramic  space  becomes  visible  at  once, 
however,  both  the  usual  and  the  inverted 
perspective  will  appear  simultaneously. 
This  is  why  at  the  first  glance  one  has  dif¬ 
ficulties  to  orient  himself  in  this  type  of 
picture.  However,  using  appropriate  soft¬ 
ware,  the  ring  shaped  image  can  be  „folded 
out”  „straightened  out”,  i.e.,  the  360°  pano¬ 
ramic  image  displayed  in  polar  coordinates 
can  be  converted  into  Cartesian  coordi¬ 
nates,  and  the  mentioned  discomfort  im¬ 
mediately  disappears. 


Fig.  2.  Formation  of  a  miniaturized  image  volume 
of  the  3D  space  encircling  the  PAL. 

One  consequence  of  this  type  of  CMI  is 
that  not  a  real  but  a  virtual  image  is  formed 
inside  the  PAL.  Better  to  say,  -  as  shown  in 
Fig.  2,  -  a  virtual  image  volume,  which  can 
be  regarded  as  a  miniaturized  image  vol¬ 
ume  of  the  3D  space  encircling  the  imag¬ 


ing  block,  and  one  can  assume  that  it  con¬ 
tains  all  the  imaging  point  data  from  the 
real  3D  space 

Geometrical  characteristics  of  PALs 

A  PAL  can  be  considered  to  be  basically 
of  catadioptric  type,  since  it  consists  of  a 
single  piece  of  glass  that  has  two  refractive 
and  two  reflective  surfaces.  This,  however, 
means  that  the  number  of  the  possible 
shapes  amounts  to  the  number  of  the  itera¬ 
tive  variations  of  the  4th  class  that  can  be 
performed  of  three  elements,  i.e.,  to  81. 


Some  of  these  shapes,  however,  are 
more  suitable  for  a  given  CMI  task  than 
others;  further,  the  refractive  index  of  the 
glass  material  used  is  also  an  image  deter¬ 
mining  factor.  Thus,  practically  for  each 
sort  of  application  a  customized  optical 
design  is  needed.  To  help  to  develop  ap¬ 
propriate  design  programs,  we  have  intro¬ 
duced  the  concept  of  the  standard  PAL. 


Fig.  3.  Scheme  of  the  standard  PAL. 

1  and  4  -  refracting  surfaces  with  antireflection 
coating 

2  and  3  -  reflecting  surfaces 

One  characteristic  of  the  standard  PAL 
is  that  one  can  derive  numerical  values 
which,  when  multiplied  with  the  radius  of 
the  best-fit  sphere,  provide  the  geometric 
parameters  that  permit  to  compare  the 
various  PAL  designs.  So,  e.g., 

Hlmax  =  H2max  =  0.92388  R, 
Hlmin  =  H3max  =  0.38268  R, 
H2min  =  H4max  =  0.38268  R, 
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where  R  is  the  radius  of  the  best-fit  sphere 
in  question. 

The  simplest  shape  is  where  all  the 
curved  surfaces  have  the  same  radii,  equal 
to  the  radii  of  the  best-fit  spheres  for  the 
aspherics  that  are  needed  for  high-quality 
imaging.  These  radii  were  taken  in  the  first 
design  steps  as  unity. 

The  expression  “ best-fit  sphere ”  is  re¬ 
lated  to  a  sphere,  which  intersects  the  as¬ 
pheric  in  question  at  the  center  and  at  the 
edge,  and  is  sometimes  referred  to  as  “en¬ 
velope  sphere”.  Methods  to  calculate  the 
best  fit  sphere  have  been  reported.2,3  Per¬ 
haps  the  simplest  routine  would  be  to  cur- 
vefit  a  circle  to  the  aspheric  in  question  in 
such  a  way  as  to  minimize  the  square  of 
the  deviation  of  the  circle  from  the  as¬ 
pheric  curve. 

In  designing  PAL  optics,  one  way  is  to 
define  the  maximum  distance  between  the 
best-fit  sphere  and  the  aspheric  in  question, 
called  aspheric  departure,  A,  which  could 
be  described  approximately  as 

A  =  D4/4096f3 

where  D  is  the  diameter  of  the  PAL,  and  f 
is  the  focal  length  of  the  aspheric. 

In  the  beginning  of  our  investigations  we 
thought  that  significant  improvementsin 
the  imaging  quality  could  be  expected  by 
changing  at  least  one  of  the  PAL  surfaces 
“back  to”  aspherics.  Starting  from  the  rea¬ 
soning  that  the  sensitivitiy  of  an  optic  de¬ 
pends  -  among  others  -  upon  the  ratin  of 
the  surface’s  radius  of  curvature  to  its  di¬ 
ameter  and  that  the  first  reflecting  surface 
of  PAL  is  the  most  sensitive  out  of  the  four 
surfaces  to  a  change  in  conic  constant,  we 
were  thinking  to  “go  back”  to  aspherics  at 
this  surace. 

Further,  we  gave  thoughts  also  to  the 
fact  that  one  of  the  surfaces  of  PAL  (the 
reflecting  concave  surface)  can  be  consid¬ 
ered  to  have  an  “obstruction”  the  best  fit 
sphere  has  to  be  defined  as  the  sphere  that 
intersects  the  aspheric  at  the  edge  of  the 
obstruction,  and  the  outer  edge  of  the  PAL. 


Our  investigation  so  far,  however,  has 
not  really  supported  the  assumption  that  by 
the  above  mentined  means  the  performance 
of  a  PAL  could  be  significantly  improved; 
so,  for  the  time  being,  we  stopped  our  in¬ 
vestigation  in  this  direction,  but  we  intend 
to  go  on  with  it  if  other  requirements 
emerge. 

Design  considerations 

To  deleop  new  PAL  desings  our  first 
step  was  to  compare  the  shape  and  maerial 
parameters  of  the  PALs  made  so  far  with 
the  data  “recommended”  by  the  “standard 
PAL’  model,  based  on  their  imaging 
wualities.  We  tried  to  find  out  the  meaning 
and  cause  of  the  differences  we  observed. 
The  result  of  these  investigation  was  that 
design  of  new  shapes  and  glass  material  is 
needed,  especially,  if  we  wish  to  develop  a 
humanoid  version  of  PAL,  i.e.,  a  version 
which  renders  not  only  a  360°  panoramic 
ring  shaped  image  but  also  has  a  central, 
i.e,  foveal,  vision.  This  is  especially  im¬ 
portant  in  developing  the  sniper  fire  loca¬ 
tion  display  (SFLD)  and  the  helicopter 
blade  tracking  system  (HBTS) 

HMVS 

The  construction  of  a  humanoid  ma¬ 
chine  vision  system  version  of  a  PAL  is 
made  possible  by  the  fact  that  the  central 
region  around  the  optical  axis  of  the  PAL 
does  not  take  part  in  forming  the  annular 
image.  It  allows  only  that  the  image  form¬ 
ing  rays  travel  from  one  surface  to  the 
other.  Thus,  if  a  lens-mirror  combination 
is  put  in  front  of  the  PAL  -  after  removing 
a  portion  of  the  reflecting  coating  of  the 
concave  surface  around  the  optical  axis  in 
such  a  way  that  the  image  plane  of  this 
lens-mirror  combination  coincides  with  the 
virtual  image  plane  inside  the  PAL,  an  im¬ 
age  will  be  formed  in  the  central  region  of 
the  annular  picture,  which  otherwise  is 
black  and  contains  no  image  information. 
Its  role  is  similar  to  the  foveal  image  in 
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human  vision,  and  this  is  the  reason  why  it 
is  called  Humanoid  Machine  Vision  Sys¬ 
tem. 


f:~18  mm 


f:  ~4  mm 

Fig.  4.  Various  lengths  of  PAL  mount 

First  of  all,  we  had  to  determine  the  ex¬ 
act  location  of  the  virtual  image  plane  in¬ 
side  the  PAL,  then,  to  find  out  those  pa¬ 
rameters  of  the  foveal  optic  that  permit  to 
project  this  real  image  exactly  to  the  center 
of  the  virtual  image  plane.  This  should  be 
achieved  in  such  a  way  that  only  a  single 
relay  lens  is  needed  to  project  the  pano¬ 
ramic  and  the  foveal  image  onto  the  re¬ 
cording  surface  (CCD  chip),  which  is  not  a 
simple  task  at  all. 

Preliminary  data  to  find  correlation 
between  the  focal  length  of  the  relay  optic 
needed  to  project  this  “image  complex” 
onto  the  image  sensor  showed,  -  as  it  can 
be  seen  in  Fig.  4  -  that  the  shorter  the  focal 
length  the  shorter  the  mount  needed  to 
couple  the  PAL  to  the  image  sensor,  pro¬ 
vided  that  neither  the  optical  geometric  pa¬ 
rameters  of  the  PAL-foveal  assembly  nor 
the  image  sensors  change. 

We  wanted  to  use  off-the-shelf  optics 
for  the  task  of  relay  lenses,  however,  it 
turned  out  that  we  are  better  off  if  we  re¬ 
gard  in  our  design  the  PAL-foveal  lens- 
relay  lens  system  as  a  single  unit. 

After  having  realized  this,  we  started  to 
design  a  HMVS  that  followed  this  concept. 
It  turned  out  that  the  ZEMAX-EE  program 
is  not  capable  to  handle  directly  these  re¬ 
quirements.  Fortunately,  we  have  found  a 


way  to  ovecome  this  difficulty,  and  the  re¬ 
sult  can  be  found  in  Appendix  I. 

This  PAL  -  foveal  lens  -  relay  lens 
system  is  based  on  a  PAL  having  a  diame¬ 
ter  of  about  50  mm.  (Fig.  5) 


Fig.  5.  PAL  050  mm.  Please  note  that  no  coatings 
are  on  the  PAL. 

Although  the  imaging  characteristics  of 
this  HMVS  seem  to  be  rather  good,  we 
think  that  before  realizing  it,  a  slight  modi¬ 
fication  of  the  geometric  parameters  is  ad¬ 
visable,  not  only  to  further  improve  the  im¬ 
age  performance  but  also  to  reduce  the 
overall  dimensions  of  the  system.  This  is 
going  to  be  not  very  easy,  nevertheless,  we 
already  started  to  look  more  closely  into 
this  matter.  The  first  tentative  trials  can  be 
seen  in  Appendix  II. 

PALs  for  stereoscopic  measurements 

Another  way  of  thinking  and  designing 
is  needed  when  a  vision  module  for  stere- 
opsis  is  considered.  The  idea  to  use  PAL 
for  this  purpose  is  not  new.  The  so-called 
PALIMADAR  (PAL-based  Imaging  Mod¬ 
ule  for  All-round  Data  Acquisition  and  Re¬ 
cording)  4  was  thought  for  stereoscopic 
measurements,  however,  these  designs  per¬ 
formed  only  horizontally:  for  vertical 
measurements  they  had  to  be  turned  around 
the  optical  axis  of  the  system. 

In  our  Statement  of  Work ”  we  ex¬ 
pressed  the  idea  to  create  a  vision  module 
where  panoramic  stereopsis  can  be  formed 
without  the  need  for  turning.  This  would 
be  based  on  the  „ellipsoid-based”  PAL 
concept,  where  two  concentric  panoramic 
images  -  one  virtual  and  one  real  -  ares 
formed.  Design  of  such  a  system  could 
have  the  following  steps 

1.  Let  the  F2  focus  be  on  the  horizontal 
axis  at  a  distance  2R/3  to  the  right  from  the 
origo  O  of  the  Cartesian  coordinate  system, 
and  a  point  M  at  the  same  distance  to  the 
left,  R  being  the  radius  of  the  best-fit 
sphere  of  PAL.  Let  us  draw  a  perpendicu¬ 
lar  to  the  horizontal  axis  in  this  point  M, 
and  at  a  distance  2R/3  from  point  M  will  be 
the  focal  point  F]  of  the  ellipse. 

2.  The  line  connecting  foci  Fi  and  F2 
will  provide  the  major  axis  2a,  and  the 
point  C  where  this  intersects  the  vertical 


axis  of  the  Cartesian  coordinate  system 
will  be  the  center  of  the  ellipse. 

3.  The  upper  extreme  points  1,2  of  the 
optique  will  be  obtained  when  a  circle  of 
radius  R  is  drawn  with  point  O  as  origo, 
and  intersects  the  line  drawn  in  point  C 
parallel  with  the  horizontal  axis  of  the  co¬ 
ordinate  system. 


4.  The  extreme  points  3,4  of  the  minor 
axis  2b  of  the  ellipse  are  located  at  the 
points  where  circles  of  radius  R  drawn 
from  points  Fj  and  F2,  respectively,  inter¬ 
sect  the  line  drawn  perpendicular  to  the 
major  axis  2a  in  point  C. 

5.  The  lower  extreme  points  6,7  can  be 
obtained  by  drawing  a  parallel  line  to  the 
horizontal  axis  at  a  distance  R/5  from  the 
extreme  point  3  of  the  minor  axis. 


6.  As  a  result  of  these  construction 
steps  the  cross  section  of  an  optical  ele¬ 
ment  is  obtained.  Let  us  now  rotate  this 


5 


structure  around  the  vertical  axis  of  the 
Cartesian  coordinate  system,  so  that  an  el¬ 
lipsoid-like  body  is  obtained.  However,  it 
is  neither  an  oblate  nor  a  prolate  spheroid 
since  its  axes  have  a  declination  to  the  axis 
of  rotation.  When  used  as  a  centric  minded 
imaging  block,  the  spherical  surface  is  re¬ 
fractive  and  the  elliptic  is  reflective. 


7.  If  the  directrices  of  point  M  are  rj  and 
r2,  one  can  write  with  good  approximation 
for  the  radius  R  of  the  PAL  which  will  be 
embedded  into  the  ellipsoid:  (r;  r2)3/2/ab. 


system  that  allows  stereoscopic  measure¬ 
ments  in  all  directions.  It  has  two  pano¬ 
ramic  visual  fields:  one  belongs  to  the  el¬ 
lipsoid  and  another  to  the  embedded  PAL. 
The  resulting  two  panoramic  annular  im¬ 
ages  have  a  region  where  they  intersect, 


which  then  can  be  used  for  stereoscopi 
measurements/ 

We  started  the  design  of  this  system  by 
using  our  ZEMAX  software  for  ray  tracing. 
However,  it  turned  out  very  soon  that 
ZEMAX  cannot  handle  this  problem,  be¬ 
cause  it  is  only  suitable  for  ray  tracing  of 
oblate  or  prolate  spheroids,  and  not  sphe¬ 
roids  with  axis  declination  to  the  axis  of 
rotation.  Further,  it  has  also  difficulties  to 
handle  the  situation  where  the  elliptical 
surface  is  reflecting,  and  the  spherical  sur¬ 
face  is  refracting. 

As  long  as  we  cannot  find  out  how  the 
present  ZEMAX  program  can  be  modified 
to  handle  the  above  mentioned  problems, 
we  make  some  concessions,  and  modify 
our  design  by  aborting  the  ellipsoid  to  a 
sphere,  i.e.,  a=b. 

To  prove  that  this  way  of  thinking  is 
sound,  and  we  get  two  panoramic  visual 
fields:  one  belonging  to  this  sphere,  and 
another  to  the  embedded  PAL,  we 
constructed  such  a  unit,  as  shown  below. 
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SATELLITE:  a  PAL  image  processing 
software 

In  our  “Statement  of  Work”  it  was  pro¬ 
posed  to  develop  a  software  for  straight¬ 
ening  out  the  annular  image,  i.e.,  to  trans¬ 
form  it  into  Cartesian  coordinates,  which 
means  to  a  rectangular  frame  showing  the 
360°  panorama  in  the  usual  and  correct 
vertical  stance. 


The  SATELLITE  software  we  have  de¬ 
veloped  performs  all  these  requirements 
and,  in  addition,  it  is  suitable  for  various 
image  processing  tasks.  The  suffix  Version 
1 .0  indicates  our  intention  to  expand  in  the 
future  these  capabilities  for  more  sophisti¬ 
cated  measurements  in  3D  environment. 
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Our  main  goal  was  to  create  a  software 
that  can  be  used  for  various  configurations 
consisting  of  PAL-optics,  relay  lens,  and 
CCD,  and  this  without  the  need  for  re¬ 
calibration. 

To  achieve  this,  the  calibration  process 
contains  the  following  steps: 


Set  angles,  which  means  that  the  viewing 
angles  above  and  below  the  horizon  of  the 
given  PAL  are  stored; 

Assign  the  upper  viewing  angle:  point  with 
the  cursor  arrow  to  the  image  point  nearest 
to  the  center  of  the  PAL  image; 
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Assign  the  lower  viewing  angle:  point  with 
the  cursor  arrow  to  the  image  point  that  is 
at  the  rim  of  the  PAL  picture. 

Assign  the  center  point:  point  with  the  cur¬ 
sor  arrow  at  the  center  of  the  black  spot 
inside  the  PAL  image  by  using  the  x  and  y 


coordinate  data  displayed  on  the  bottom  of 
the  screen. 

If  once  the  data  are  stored,  in  any  pano¬ 
ramic  image  delivered  by  the  actual  PAL- 
relay  lens-CCD  configuration,  the  circle  of 
the  horizon  can  be  displayed  in  a  selected 
color. 


To  “unwarp”,  to  “straighten  out”,  the 
option  “TRANSFORM”  from  the  toolbar 
has  to  be  used,  and  then  you  can  choose, 
from  which  direction  the  unwarping  should 
start. 


Clicking  on  the  “SPLIT”  option  will 
result  in  two  rectangular  images  giving  you 
an  idea  what  you  would  see  at  your  left  and 
right  hand  side  when  looking  in  the  direc¬ 
tion  where  unwarping  started. 

EMM 


SATELLITE 


Processing  is  always  more  precise  and 
easier  when  it  is  performed  in  gray  scale, 
rather  than  in  colors.  The  program  offers 
the  option  to  switch  to  gray  scale  by  click¬ 
ing  on  ’’Preprocess”  on  the  toolbar.  At  pre¬ 
sent,  one  has  the  option  to  use  various  fil¬ 
ters,  further,  to  subtract,  add,  multiply,  di¬ 
vide  two  image  data. 

Version  1.0  will  handle  in  the  future 
various  measurements,  e.g.,  distance  as¬ 
sessment,  etc. 

These  are  based  on  the  already  men¬ 
tioned  characteristics  of  the  PAL  namely, 
that  the  width  of  the  resulting  annulus  rep¬ 
resents  the  viewing  angle  of  the  PAL  in  its 
optical  axis,  thus,  each  pixel  along  the  radii 
of  the  projected  annular  image  represents 
the  direction  of  an  object  point  in  space, 


i.e.,  the  azimuth  value  of  this  object  point 
can  be  obtained  quantitatively. 

To  demonstrate  the  steps  of  functioning 
of  our  SATELLITE  software  we  have  cho¬ 
sen  a  panoramic  image  recorded  in  Paris, 
because  it  contains  objects  of  various 
heights,  among  others,  the  Eiffel  Tower. 

If  we  touch  with  the  cursor  arrow  the 
top  of  the  Eiffel  tower,  it  prints  out  imme¬ 
diately  the  elevation  value,  i.e.,  the  angle 
value  above  the  PAL’s  horizon.  (Just  to 
remember:  horizon  is  the  plane  where  the 
spherical  surfaces  intersect) 

Since  the  height  of  the  Eiffel  Tower  is 
known  (352  m),  it  is  not  too  difficult  to 
calculate  the  distance  from  where  the  pic¬ 
ture  was  shot,  because  the  azimuth  angle  is 
numerically  displayed.  (Fig.  6) 


Fig.  6.  Displaying  the  elevation  of  the  top  of  the 
Eiffel  tower  in  GON  units  (left)  and  showing  on  the 
map  the  place  from  where  this  PAL  picture  was 
recorded  (point  P  on  the  map,  right) 

To  rectify  the  panoramic  ring  shaped 
image,  anamorphic  method  can  be  used. 
Either  a  mirror  cylinder  is  placed  vertically 
on  the  center  of  the  annular  picture  or,  with 
the  aid  of  the  CorelDraw  7.0  software,  a 
virtual  mirror  cylinder  displays  the  recti¬ 
fied  version  of  the  panoramic  view  -  as 
shown  in  Fig.  7.  Both  techniques  can  be 
used  to  test  the  performance  of  the  PAL: 
radial  lines  show  up  as  vertical  rods. 
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Azimuth  determination  system  (ADS) 

The  proposed  azimuth  determination 
system  is  based  in  part  on  the  SATELLITE 
1.0  software,  which  allows  us  to  define  the 
direction  of  any  object  point  in  space.  We 
showed  previously  that  PAL  allows  direct 
distance  measurement  of  an  object  if  one 
knows  its  height.  Distance  can  also  be 
measured  without  knowing  the  height  of 
the  object,  only  so-called  structured  light 
illumination  is  needed.  Let  us  illuminate 
the  object  in  question  with  structured  light 
(laser  beam),  then,  for  an  illuminated  ob¬ 
ject  point  below  the  horizon  of  the  optic, 

h,  =Rtga1( 

and  for  an  object  point  above  the  horizon 
of  the  optic, 

h2  =  R  tg  a2 

where  R  is  the  distance  of  the  object  point 
from  the  optical  axis.  It  is  known  that  in  an 
annular  image  delivered  by  PAL  radial 
lines  mean  lines  in  space  parallel  to  its  op¬ 
tical  axis.  On  the  other  hand,  the  distance 
of  the  plane  of  the  structured  light  from  the 
plane  of  the  optical  horizon  (hf  and  h2)  is 

known,  the  prevailing  distance  of  the  illu¬ 
minated  object  point  (object)  from  the  op¬ 
tical  axis  can  easily  be  determined.  (Fig. 


8) 

Fig.  8.  Principle  of  azimuth  determination. 

It  follows  from  the  fact  that  points  at 
equal  distances  from  the  optical  axis  of 
PAL  lie  on  the  same  circle  in  the  ring 


image,  range-imaging  strategies  can  be 
worked  out. 

Sniper  fire  location  display  (SFLD) 

The  sniper  fire  location  display  pro¬ 
posed  is  based  on  a  PAL  that  has  a  central, 
so-called  foveal  vision  too,  i.e.,  it  is  a 
Humanoid  Machine  Vision  System 
(HMVS).  Combining  HMVS  with  a 
rotating  mirror,  a  selected  scene  of  the 
panoramic  image  can  be  projected  into  the 
center  of  the  annulus,  even  with 
magnification.  This  means  that  a  sniper 
fire,  which  suddenly  glares  up  somewhere 
in  the  360°  peripheral  panoramic  annular 
image,  can  be  displayed  simultaneously  in 
the  center  of  the  annulus,  so  that  it  can  be 
located. 

For  our  preliminary  experiments  we 
have  modified  one  of  our  existing  PALs  by 
removing  a  portion  of  the  reflecting  layer 
on  the  concave  surface,  as  shown  in  Fig.  9. 


Fig.9.  Modified  PAL  with  foveal  vision 


The  first  experiments  showed  that  the 
idea  is  working,  however,  the  quality  of  the 
foveal  image  was  rather  poor  (Fig.  10) 


Fig.  10.  Foveal  image  in  the  center  of  PAL 

After  having  realized  this  we  started  to 
re-design  the  PALs  using  the  ZEMAX-EE 
program,  which  allows  creation  of  foveal 
image  with  higher  quality.  The  result  can 
be  found  in  Appendix  I. 

Among  the  requirements  for  SFLD 
there  is  a  measure  of  the  speed  of  the 
movement  of  the  observed  object  point. 
First,  we  thought  to  couple  the  PAL  image 
through  a  rotating  dove  prism  to  a  linear 
CCD  consisting  of  5000  pixels  of  the 
size  7  pm  by  7  pm.  This  would  mean  that 
in  each  turn  of  the  prism  the  entire  ring  im¬ 
age  surface  will  be  swept  over  twice,  each 

o 

time  with  a  resolution  of  1.57.10  pixels. 
Since  the  rotation  speed  of  the  prism  is 
known,  the  speed  of  the  movement  of  the 
observed  object  point  could  be  calculated 
with  an  appropriately  designed  software. 

It  turned  out,  however,  that  -  in  spite  of 
the  fact  that  this  method  offered  very  high 
resolution  -  very  severe  hardware  prob¬ 
lems  had  to  be  solved,  which  seemed  to  be 
not  in  balance  with  the  resolution  one 
could  obtain. 

Thus,  we  concluded  to  abandon  -  at 
least  for  the  time  being-  this  version  of 
solution,  and  try  to  exploit  the  advanced 
properties  of  the  cellular  neural  network 
CNN  focal  plane  array  processor  chip,  al¬ 
though  its  pixel  number  is  only  64  by  64. 

Consulting  with  the  team  of  AnaLogic 
Computers,  Ltd.,  we  decided  to  further 
pursue  this  idea  and  apply  for  a  joint  Spe¬ 
cial  Project  Contract  to  carry  out  calcula¬ 
tions  and  investigation  in  more  detail.  We 
hope  that  this  would  lead  us  to  a  solution 
that  could  be  put  into  practical  application. 

SFLD  would  really  be  useful  when  it 
could  be  combined  with  a  head  display.  To 
demonstrate  the  idea  we  had  in  mind  we 
put  on  the  top  of  a  helmet  a  PAL  that  was 
coupled  to  a  board  camera  placed  inside 
the  helmet,  and  displayed  the  resulting 
panoramic  image  on  the  Personal  Monitor 
of  ALBACOMP.  It  weighs  only  36  grams 


and  can  be  mounted  on  any  eyeglasses. 
(Fig.  11)  The  PAL  image  appears  in  the 
person’s  line  of  sight  in  a  viewing  angle 
comparable  to  a  viewing  of  a  61  cm 
monitor  from  about  2  m  away. 


Fig.  11.  Breadboard  model  for  PAL-based  SFLD 
with  ALBACOMP  Personal  Monitor. 


Although  similar  personal  monitors  are 
available  on  the  market,  this  ALBACOMP 
product  has  the  advantage  that  the  video 
image  is  seen  around,  it  covers  only  the 
area  where  the  image  appears,  otherwise 
users  are  free  to  view  the  surrounding  en¬ 
vironment.  This  means  that  a  constantly 
available  image  is  in  the  person’s  line  of 
sight,  it  enables  to  maintain  focus  and  at¬ 
tention,  it  keeps  the  integrity  of  the  sur¬ 
rounding  environment.  (Fig.  12) 


Fig.  12.  Person  wearing  helmet  equipped  with  eye¬ 
glass-mounted  Personal  Monitor  combined  with 


PAL 


Fig.  13.  What  the  person  of  Fig.  12. sees. 


Both  the  ring  shaped  PAL  picture  displaying  the  360° 
panoramic  view  around  the  helmet  wearing  person  and 
its  straightened  out  version  can  be  viewed  on  the  Per¬ 
sonal  Monitor. 

The  striking  advantage  of  this  Personal  Monitor  of 
ALBACOMP  is  that  it  enables  the  person  to  maintain 
focus  and  attention  in  keeping  the  integrity  of  the  sur¬ 
rounding  environment.  This  property  could  especially 
be  exploited  in  sniper  fire  location. 


Helicopter  Blade  Tracking  System  (HBTS) 


To  find  out  which  rotor  blade  or 
blades  are  riding  out  of  track,  the 
blades’  functioning  is  measured  in 
general  sequentially. 

Since  all  the  rotating  blades  are 
of  the  same  length,  their  tips  have  to 
run  -  if  balanced  correctly  -  on  the 
same  circle  in  a  PAL  image,  pro¬ 
vided  that  the  optical  axis  of  the  PAL 
coincides  with  the  center  of  the  main 

rotor  drive  shaft. 


This  means  that  the  position  and/oi 
deflection  of  all  the  blades  of  the  heli¬ 
copter  can  be  measured  simultane¬ 
ously,  both  angularly  in  relation  tc 
each  other,  and  perpendicularly  to  the 
>lane  of  rotation  in  relation  to  the  ro- 
ation  speed.  If,  namely,  the  rotoi 
>lades  are  not  balanced  correctly,  the 
ip  of  that  one  that  is  not  balanced  cor- 
ectly  will  run  on  a  different  circle,! 
■independently  whether  the  blades  are| 
Tin  dropped  or  upwards  position. 


Fig.  14.  PAL-image  of  a  rotating  ceiling  fan’s  blades,  and  its  straightened  out  version.  Please  remember  that  what 
a  PAL-image  shows  is  not  a  cross  section,  it  is  rather  the  two-dimensional  skeleton  of  the  3D  space.  As  a  conse¬ 
quence,  the  amount  of  twist  of  each  blade  can  also  be  observed 


To  check  the  validity  of  our  assumption 
that  a  PAL-based  measuring  system  could 
be  developed  for  helicopter  blade  tracking, 
-  which  could  be  used  even  during  flight  - 
we  have  shot  some  PAL  pictures  from  a 
rotating  ceiling  fan,  the  result  of  which  can 
be  seen  above.  These  pictures  clearly 


showed  that  there  is  a  crucial  factor:  the 
optical  axis  of  the  PAL  should  strictly  co¬ 
incide  with  the  axis  of  rotation  of  the 
blades. 

Discussions  on  this  idea  and  our  find¬ 
ings  with  helicopter  experts  of  the  Hun- 


garian  Air  Force  resulted  in  some  non- 
The  first  problem  we  are  facing  is  to 
find  the  place  on  the  helicopter  where  the 
CCD  equipped  PAL  should  be  put,  and 
find  the  way,  how  to  fix  it  so  that  the 
optical  axis  of  the  PAL  coincide  with  the 
rotation  axis  of  the  blades.  This  should  be 
accomplished  in  such  a  way  that  this 
relation  remains  constant,  even  if 
unavoidable  vibrations  occur.  Looking  at 
the  left  side  of  Fig.  15,  one  must  realize 
that  it  is  not  an  easy  engineering  task. 
During  our  discussions  it  turned  out  that 


expected  answers  to  the  problems  outlined, 
helicopter  pilots  are  less  interested  in 
knowing,  what  extent  the  rotating  blades 
are  going  out  of  track;  they  desperately 
want  to  know  exactly  the  moment  for  each 
blade  when  they  start  to  go  out  of  track. 
The  signal  that  this  event  is  close  manifests 
itself  in  a  very  low  amplitude  vibration  of 
the  tips  of  the  blades.  This  gave  us  the  idea 
to  let  rotate  the  PAL-equipped  camera, 
instead  of  fixing  it,  thus,  the  image  on  the 
monitor  will  show  each  blade  in  such  a 
way  if  they  would  stand  still. 


Fig.  15.  Lay  out  of  a  helicopter  rotary  shaft. 


At  the  same  time,  however,  any  motion 
of  the  tip  of  the  blade  can  be  not  only  visu¬ 
alized  but  also  measured  with  an  accuracy 
depending  upon  the  resolution  of  the  CCD 
used. 

The  advantage  of  this  solution  is  that  it 
is  easier  to  find  the  place  for  the  PAL- 
equipped  board  camera.  Namely,  below  the 
closing  cap  of  the  rotary  shaft  -  as  shown 
on  the  right  side  of  fig.  15  -  there  is  enough 
room,  and  the  requirements  for  keeping  the 
axes  in  one  straight  line  can  also  be  ful¬ 
filled  with  great  accuracy. 


Preliminary  experiments  in  this  regard 
are  about  starting. 
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